Systems and methods for automated real-time Internet streaming and broadcasting

ABSTRACT

A real-time Internet streaming system and method includes a scheduling server that receives queries from media streaming devices and determines if any scheduled events associated with a particular media streaming devices is an active scheduled event by comparing the scheduled events with time and date information. When there is an active scheduled event the scheduling server sends a response to the media streaming device to stream a media stream to a media server. When the scheduling server determines that an active scheduled event is no longer active, the scheduling server sends a response to the media streaming device to stop streaming. The media server can send the media stream or a resampled version of the media stream to a plurality of viewing devices or archive the media stream for later playback. The real-time Internet streaming system can include a scheduling server, media servers, and a plurality of media streaming devices.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims the benefit of U.S. Provisional Application No.62/024,565, entitled “SYSTEMS AND METHODS FOR AUTOMATED REAL-TIMEINTERNET STREAMING AND BROADCASTING,” filed Jul. 15, 2014, thedisclosure of which is hereby incorporated herein by reference in itsentirety.

TECHNICAL FIELD

Embodiments of the technology relate, in general, to automated real-timeInternet streaming of user-created content, and in particular toautomation systems and methods that allow users to start, stop, andmodify in real-time the broadcasting of live video streams over theInternet.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure will be more readily understood from a detaileddescription of some example embodiments taken in conjunction with thefollowing figures:

FIG. 1 depicts an example automated real-time Internet streaming system,according to one embodiment.

FIG. 2 depicts an example computing device, according to one embodiment.

FIG. 3 depicts an example streaming server, according to one embodiment.

FIG. 4 depicts example operations for scheduling streaming events,according to one embodiment.

FIG. 5 depicts example operations of an NV streaming encoder and ascheduling server of an automated real-time Internet streaming system,according to one embodiment.

FIG. 6 depicts example communication flows of an automated real-timeInternet streaming system, according to one embodiment.

DETAILED DESCRIPTION

Various non-limiting embodiments of the present disclosure will now bedescribed to provide an overall understanding of the principles of thestructure, function, and use of automated real-time Internet streamingsystems and methods disclosed herein. One or more examples of thesenon-limiting embodiments are illustrated in the accompanying drawings.Those of ordinary skill in the art will understand that systems andmethods specifically described herein and illustrated in theaccompanying drawings are non-limiting embodiments. The featuresillustrated or described in connection with one non-limiting embodimentmay be combined with the features of other non-limiting embodiments.Such modifications and variations are intended to be included within thescope of the present disclosure.

Reference throughout the specification to “various embodiments,” “someembodiments,” “one embodiment,” “some example embodiments,” “one exampleembodiment,” or “an embodiment” means that a particular feature,structure, or characteristic described in connection with any embodimentis included in at least one embodiment. Thus, appearances of the phrases“in various embodiments,” “in some embodiments,” “in one embodiment,”“some example embodiments,” “one example embodiment, or “in anembodiment” in places throughout the specification are not necessarilyall referring to the same embodiment. Furthermore, the particularfeatures, structures or characteristics may be combined in any suitablemanner in one or more embodiments.

Described herein are example embodiments of computer-based systems andmethods that allow users, such as system administrators for houses ofworship, educational environments, music halls, and other venues, toautomate broadcasts and streaming of live audio and video content overthe Internet to receivers, such as computers, mobile devices, and settop boxes. The examples discussed herein are examples only and areprovided to assist in the explanation of the apparatuses, devices,systems and methods described herein. None of the features or componentsshown in the drawings or discussed below should be taken as mandatoryfor any specific implementation of any of these the apparatuses,devices, systems or methods unless specifically designated as mandatory.For ease of reading and clarity, certain components, modules, or methodsmay be described solely in connection with a specific figure. Anyfailure to specifically describe a combination or sub-combination ofcomponents should not be understood as an indication that anycombination or sub-combination is not possible. Also, for any methodsdescribed, regardless of whether the method is described in conjunctionwith a flow diagram, it should be understood that unless otherwisespecified or required by context, any explicit or implicit ordering ofsteps performed in the execution of a method does not imply that thosesteps must be performed in the order presented but instead may beperformed in a different order or in parallel.

Referring to FIG. 1, an embodiment of an automated real-time Internetstreaming system 100 can include streaming devices 102 that stream liveaudio and video user-created content, viewing devices 104 that displaythe user-created content to a viewer, and servers 106 that receive,store, and stream the user-created content. Example streaming devices102 can include NV devices 110 (audio/video devices) that are connectedto encoders 112, a mobile device 114 that has a camera and streamingsoftware, and a networked camera 116. Generally, the streaming devices102 capture and process audio/video content (A/V content) into a formatsuitable for transmission across the Internet 108 to a server 106. Theencoding format can be proprietary or can be standards-based, forexample, H.264, VP6, VP9 or MPEG-4 which is adapted for transmission ofaudio/video content using IP or Internet Protocol or standards-basedRTSP or RTMP protocols.

An encoder 112 can be configured to accept the audio/video signals froman NV device 110 that is not configured to stream A/V content andconvert it to a format suitable for streaming across the Internet 108 tothe servers 106. Mobile devices 114 can use software configured to takethe A/V content from a camera and microphone on the mobile device 114and stream it to a server 106, for example by sending it wirelesslythrough a local Wi-Fi/802.11x network or over a cellular data network(not separately shown). Network cameras 116 can be configured to streamA/V content to the server, for example using a wired connection to alocal network, or using a wireless Wi-Fi/802.11x local network. Theencoder 112, mobile device 114, and network camera 116 can each be acomputing device, as described below, which executes software or othercomputer instructions for streaming A/V content and receiving formattedcommands for initiating streaming operations.

In a configuration, a streaming device 102 can be a PC, Mac or Linuxbased computer capable of capturing and encoding audio and video inputsfrom cameras, video switchers, webcams, soundboards, microphones, andthe like. The streaming device 102 can encode and transmit the encodedaudio and video inputs for broadcast onto the Internet. In aconfiguration, the automation software residing on the streaming device102 can include third-party software to parse responses from a RESTfulAPI, or Representational State Transfer Application ProgrammingInterface call such as WAMP Server for Windows-based computer. Linux andMac based streaming device 102 can use the native PHP software toperform parsing of responses from the RESTful API calls.

Viewers can use a viewing device 104 to view streaming A/V content.Example viewing devices 104 can include mobile user devices 130, usercomputing devices 132, and set top boxes 134 among other types ofviewing devices 104. A mobile user device 130 can be a mobile phone, asmartphone, a tablet, a laptop, a gaming device, or another portablecomputing device that can be configured to execute software or othercomputer instructions to receive streaming A/V content wirelesslythrough a local Wi-Fi/802.11x network, over a cellular data network, orany other suitable type of communication network. A user computingdevice 132 can be a personal computer, a workstation, a laptop, atablet, a gaming device, an embedded device such as a computer in akiosk, or any other suitable wired or another suitable computing deviceor a device that includes a computing device capable of receivingstreaming A/V content over a wired or wireless data link. A set top box134 can be a device configured to receive streaming A/V content andconvert the A/V content to a format suitable for presentation on atelevision 136, monitor, projector, speaker system, and so forth. Forexample, a set top box 134 can be a Roku™ or AppleTV™ device thatreceives A/V content across a wired or wireless connection, and covertsthe A/V content into a format suitable for playing on a television 136.An example format suitable for playing on a television is the HDMI, orhigh definition multimedia interface connection, although other types ofconnectors such VGA, BNC and RC connectors, and other types of signalingincluding analog or digital formats are contemplated. Other types of settop boxes, computing devices, and audio, video, or NV signaling, aswould be understood in the art, are also contemplated. In variousconfigurations, the viewing devices 104 can receive just an audiostream, just a video stream, audio and video, multiple video streams,multiple audio streams, or other suitable combinations of audio andvideo content.

The servers 106 can include a scheduling server 120, an origin server122, and one or more edge servers 124. The server 106 is illustrated asa single server 106 for convenience, however in practice the operationsperformed by each server 106 can be performed by a common server orservers, or executed across multiple servers 106 as would be understoodin the art. The scheduling server 120 can have software or othercomputer instructions executing on processors that allows user, such asan administrator, to schedule live or future streaming of A/V contentfrom the streaming devices 102. The scheduling instructions can bestored in a data store which can be in the scheduling server 120 orlocated elsewhere, such as a storage server on a local network, forexample. In a configuration, the scheduling server 120 is a web-basedPHP/MySQL™ application hosted on a cloud-based datacenter such asAmazon™. In a configuration, the origin server 122, and one or more edgeservers 124 are servers 106 executing Wowza™ Streaming Engine and Wowza™Media Server on an enterprise level operating system.

The origin server 122 is configured to receive streaming A/V contentfrom one or multiple streaming devices 102 concurrently. The originserver 122 can transmit the data to one or more edge servers 124 forbroadcast to viewing devices 104. In configurations, the origin servercan store the A/V content locally or store the A/V content in a datastore, for example a network storage server. In a configuration, the A/Vcontent is stored by a third party cloud-based service such as Amazon™S3™.

The edge server 124 receives A/V content from the origin server 122 forstreaming to viewing devices 104. An edge server 124 can be directlyconnected to the origin server 122, for example using a physical link,or a dedicated network data link, as illustrated in FIG. 1 as the dottedline. In a configuration, the edge server 124 can use a data link over aLocal Area Network LAN or the Internet 108 to connect using the RealTime Messaging Protocol (RTMP) to the origin server 122. An edge server124 can be a physical server 106 configured to stream A/V content toviewing devices 104, or can be a cloud-based service provided by a thirdparty such as Amazon™ Cloudfront™. One or more edge servers 124 can beused to stream A/V content to viewing devices 104. Separating thefunctions of the edge server 124 from the origin server 122, andscheduling server 120, can provide a number of benefits. First, thereare typically more viewing devices 104 streaming A/V content than thereare streaming devices 102 streaming the user-created content. Forexample, a house of worship may be streaming a single A/V stream of aSunday morning service, while multiple users are concurrently viewingthat same Sunday morning service, each on their own viewing device 104.Therefore, it can be beneficial to have multiple edge servers 124 inorder to service the demand from all of the viewing devices 104. Second,keeping the processes of the origin server 122 separate from the edgeserver 124 can help to ensure that the origin server 122 has thenecessary available computing and networking resources for receiving A/Vcontent, and the scheduling server 120 has computing and networkingresources available for scheduling streaming events, and beingresponsive to users using the user interface.

Each server 106, in accordance with the present disclosure, can beaccessed via any appropriate and suitable technique. For example, a usersuch as an administrator can use a web-browser such as Safari™, Opera™,Google™ Chrome™, Internet Explorer™, or the like to access thescheduling server 120. A user such as a viewer desiring to stream A/Vcontent can similarly use a web-browser such as Safari™, Opera™, Google™Chrome™, Internet Explorer™, or the like to access the edge server 120.An application associated with the automated real-time Internetstreaming system 100 can execute on a processor of an encoder 112, amobile device 114, a network camera 116, a mobile user device 130, auser computing device 132, or a set top box 134 (collectively clientdevices). The application can be a web-based application or astand-alone executable as appropriate for the client device. Clientdevices can communicate using any suitable communication channels andprotocols. For example, all of the client devices of the automatedreal-time Internet streaming system 100 can use the Internet 108, asshown, as their communication network. Other suitable communicationchannels and protocols can include, without limitation, those used inmobile wireless communications as well as data links for wired andwireless networked connections. Each client device or server 106 caninclude software or other computer instructions executing on suitablecomputing hardware, such as a dedicated server, a personal computer, aserver, multiple computers, a collection of networked computers, acloud-based computer system, a web-based computer system, or from astorage device, as appropriate for the client device or server 106. Eachclient device or server 106 can include one or multiple processingunits, such as central processing units and/or graphics processingunits, may perform instructions stored in memory to execute theprocesses described herein.

Referring now to FIG. 2, an example computing device 200 is presented.The processes described herein can be performed on or between one ormore computing devices 200. A computing device 200 can be a server, acomputing device that is integrated with other systems or subsystems, amobile computing device, a cloud-based computing capability, and soforth. For example, the computing device 200 depicted in FIG. 2 can bethe streaming device 102, the server 106, or the viewing device 104. Thecomputing device 200 can be any suitable computing device as would beunderstood in the art, including without limitation, a custom chip, anembedded processing device, a tablet computing device, a personal dataassistant (PDA), a desktop, a laptop, a microcomputer, a minicomputer, aserver, a mainframe, or any other suitable programmable device. Invarious embodiments disclosed herein, a single component can be replacedby multiple components and multiple components can be replaced by asingle component to perform a given function or functions. Except wheresuch substitution would not be operative, such substitution is withinthe intended scope of the embodiments.

Each computing device 200 includes one or more processors 202 that canbe any suitable type of processing unit, such as a general purposecentral processing unit (CPU), a reduced instruction set computer(RISC), a processor that has a pipeline or multiple processingcapability including having multiple cores, a complex instruction setcomputer (CISC), a digital signal processor (DSP), an applicationspecific integrated circuits (ASIC), a programmable logic devices (PLD),and a field programmable gate array (FPGA), among others. The computingresources can also include distributed computing devices, cloudcomputing resources, and virtual computing resources in general.

The computing device 200 also includes one or more memories 206, forexample read only memory (ROM), random access memory (RAM), cache memoryassociated with the processor 202, or other memories such as dynamic RAM(DRAM), static ram (SRAM), programmable ROM (PROM), electricallyerasable PROM (EEPROM), flash memory, a removable memory card or disk, asolid state drive, and so forth. The computing device 200 also includesstorage media such as a storage device that can be configured to havemultiple modules, such as magnetic disk drives, floppy drives, tapedrives, hard drives, optical drives and media, magneto-optical drivesand media, compact disk drives, Compact Disk Read Only Memory (CD-ROM),Compact Disk Recordable (CD-R), Compact Disk Rewriteable (CD-RW), asuitable type of Digital Versatile Disk (DVD) or BluRay™ disk, and soforth. Storage media such as flash drives, solid state hard drives,redundant array of individual disks (RAID), virtual drives, networkeddrives and other memory means including storage media on the processor202, or memories 206 are also contemplated as storage devices. It can beappreciated that such memory can be internal or external with respect tooperation of the disclosed embodiments. It can be appreciated thatcertain portions of the processes described herein can be performedusing instructions stored on a computer-readable medium or media thatdirect a computer system to perform the process steps. Non-transitorycomputer-readable media, as used herein, comprises all computer-readablemedia except for transitory, propagating signals.

Network and communication interfaces 212 can be configured to transmitto, or receive data from, other computing devices 200 across a network216. The network and communication interfaces 212 can be an Ethernetinterface, a radio interface, a Universal Serial Bus (USB) interface, orany other suitable communications interface and can include receivers,transmitter, and transceivers. For purposes of clarity, a transceivercan be referred to as a receiver or a transmitter when referring to onlythe input or only the output functionality of the transceiver. Examplecommunication interfaces 212 can include wired data transmission linkssuch as Ethernet and TCP/IP. The communication interfaces 212 caninclude wireless protocols for interfacing with private or publicnetworks 216. For example, the network and communication interfaces 212and protocols can include interfaces for communicating with privatewireless networks 216 such as a Wi-Fi network, one of the IEEE 802.11xfamily of networks, or another suitable wireless network. The networkand communication interfaces 212 can include interfaces and protocolsfor communicating with public wireless networks 216, using for examplewireless protocols used by cellular network providers, including CodeDivision Multiple Access (CDMA) and Global System for MobileCommunications (GSM). A computing device 200 can use network andcommunication interfaces 212 to communicate with hardware modules suchas a database or data store, or one or more servers or other networkedcomputing resources. Data can be encrypted or protected fromunauthorized access, for example by using secure sockets, virtualprivate networks, and so forth.

Mobile computing devices can include inertial components 208 and globalpositioning systems components (GPS components 210). The inertialcomponents 208 and GPS components 210 can determine the terrestrialposition of the mobile computing devices. Mobile computing devices canuse the inertial components 208 and GPS components 210 in combinationwith radio transmissions received via the network and communicationinterfaces 212 to accurately determine the position of a mobilecomputing device. The position can be transmitted to other computingsystems.

In various configurations, the computing device 200 can include a systembus 214 for interconnecting the various components of the computingdevice 200, or the computing device 200 can be integrated into one ormore chips such as programmable logic device or application specificintegrated circuit (ASIC). The system bus 214 can include a memorycontroller, a local bus, or a peripheral bus for supporting input andoutput devices 204, and communication interfaces 212. Example input andoutput devices 204 include keyboards, keypads, gesture or graphicalinput devices, motion input devices, touchscreen interfaces, one or moredisplays, audio units, voice recognition units, vibratory devices,computer mice, and any other suitable user interface.

The processor 202 and memory 206 can include nonvolatile memory forstoring computer-readable instructions, data, data structures, programmodules, code, microcode, and other software components for storing thecomputer-readable instructions in non-transitory computer-readablemediums in connection with the other hardware components for carryingout the methodologies described herein. Software components can includesource code, compiled code, interpreted code, executable code, staticcode, dynamic code, encrypted code, or any other suitable type of codeor computer instructions implemented using any suitable high-level,low-level, object-oriented, visual, compiled, or interpreted programminglanguage.

Referring now to FIG. 3, example components of one embodiment of ascheduling server 300 is depicted. Components can include either or bothsoftware and hardware modules. The scheduling server 300 can include auser interface module 302 executing on the scheduling server 300 thatserves webpages that are delivered to client devices and displayed on aweb browser executing on a smartphone, a tablet, a desktop computingdevice, or notebook computing device. For example, the user interfacemodule 302 can serve web pages to a system administrator that the systemadministrator can use to configure the streaming of A/V content fromstreaming devices 102. In various configurations, some or all of theuser interfaces can execute on user equipment such as client deviceusing dedicated applications that interface with the user interfacemodule 302. For example, in a configuration, the user interface can bean application or app designed to execute on client devices, such as auser's mobile computing device, tablet, and/or smartphone. In anotherconfiguration, a user interface can be an application designed toexecute on client devices such as a personal computing device. Examplemessaging between the user interface module 302 of the scheduling server300 and the users, system administrators, and client devices caninclude, but is not limited to, HTML, XML, webpages, cookies, messagingsuch as SMS, EMS, MMS, and other types of suitable messaging, includingencrypted messages, and secure sockets, and so forth.

The scheduling server 300 can include a scheduling module 304 forsetting schedules for the streaming devices 102 to stream A/V content tothe origin server 122, which is explained in greater detail below. Thescheduling server 300 can include a validation module 308 for checkingthe scheduling for conflicts or errors, authenticating users and sourcesof A/V content, and so forth. The scheduling server 300 can include anencoder interface 310 for communication with the streaming devices 102,such as to receive RESTful API requests and submit formatted responses,for example. Communication of information between the encoder interface310 of the scheduling server 300 and streaming devices 102 can beaccomplished by sending formatted responses over HTTP, or hypertexttransfer protocol, using a RESTful API call. However, as would beunderstood in the art, communications between two or more computingdevices can be enabled using any suitable protocol and networkinginterfaces including, but not limited to, the TCP suite of protocols,HTML, XML, webpages, cookies, secure sockets, proprietary protocols, andso forth. The scheduling server 300 can include a publishing module 312for sending information about A/V content streams to the servers 106.For example, when a new scheduled event is created, a record containinginformation about the scheduled event and the A/V content can be sent tothe edge server 124 so that users can subscribe to receive the eventusing their viewing device 104 and automatically receive the A/V contentwhen it begins streaming at the scheduled time.

The scheduling server 300 can include a local data store 306. Data canbe stored in the local data store 306, an external data store,schematically depicted as cloud data 316 in FIG. 3, or any othersuitable local or network storage means. Each data store 306, 316 can bea repository of data for user information, system administratorinformation, viewer information, authentication information,configuration information for streaming devices 102, configurationinformation for viewing devices 104, edge server 124 information,scheduling information, error checking rules, scripting, A/V contentdata and information, and any other suitable information.

Referring now to FIG. 4, an example flow diagram of a scheduling processof the scheduling module 304 is presented. Processing starts at startblock 400 when a user, such as a system administrator, logs into theuser's account on the scheduling server 300. In a configuration thescheduling server 300 is a cloud-based management portal. Processingcontinues to process block 402.

In process block 402, the user interface 302 presents a schedulingscreen for one or more streaming devices 102 to the systemadministrator. In a configuration, the scheduling screen can bepresented to the system administrator using a PHP/MySQL™ web-basedapplication of an automation scheduling application hosted on serverinfrastructure running an enterprise level operating system. A systemadministrator can remotely manage a streaming device 102, such as anencoder 112, and start and stop broadcasting at pre-determined dates andtimes by defining a broadcast schedule using the scheduling screen. Thebroadcast schedule for each account can be stored in a data store 306,316. In a configuration, the data store 306, 316 is a MySQL™ database.The system administrator can access in real-time the status of each ofthe system administrator's streaming devices 102, and can determinewhether a streaming device 102 is online, is synced to the currentbroadcast schedule, or is offline. On the scheduling screen, the systemadministrator is presented with a series of online tools including theselectable option to add, modify, or delete a broadcast scheduled event.Additionally, the administrator can override the broadcast schedule andmanually start and stop a broadcast from a remote encoder. Processingcontinues to decision block 404.

In decision block 404, if the system administrator selected the optionto add a broadcast scheduled event, then processing continues to processblock 406, otherwise, processing continues to decision block 408.

In process block 406, the system administrator has the option toschedule a one-time or a recurring broadcast by specifying the start andend dates, the start and end times, viewer access, category, storageduration and data about recurring times for a broadcast scheduled event.In a configuration, the system administrator is presented with an optionto make the scheduled broadcast event a periodically recurring event,such as a weekly recurring event. Examples of weekly recurring eventscan include house of worship services, educational classes, companymeetings, and so forth. Processing continues to decision block 416.

In decision block 408, if the system administrator selected the optionto modify or edit a broadcast scheduled event, then processing continuesto process block 410, otherwise, processing continues to decision block412.

In process block 410, a scheduled broadcast event selected by the systemadministrator is retrieved from the data store 306, 316 which can be theMySQL™ database. Processing continues to process block 406 where thesystem administrator can specify changes to the start and end dates, thestart and end times, viewer access, category, storage duration andrecurring times for the selected broadcast scheduled event.

In process block 412, if the system administrator selected the option todelete a broadcast scheduled event, then processing continues to processblock 414, otherwise, processing continues to decision block 420.

In process block 414, the system administrator can select a scheduledbroadcast event to be deleted from the data store 306, 316 which can bethe MySQL™ database. Processing continues to decision block 416.

In decision block 416, the operation select by the system administratorto add, modify, or delete a scheduled broadcast event in process blocks406, 410, or 414 is validated. In a configuration, the validation module308 can verify the user rights, and perform error checking of the addedor modified broadcast scheduled event. For example, the validationmodule 308 can verify that the end time has not been configured to occurbefore the start time. The validation module 308 can use configurablerules to verify the details of the broadcast scheduled event. In aconfiguration (not shown) the system administrator can be prompted tocorrect the errors. If the system administrator has sufficient userrights and there are no errors, then processing continues to processblock 418, otherwise processing returns to processing returns to processblock 402.

In process block 418, the data store 306, 316 is updated with theaddition, modification, or deletion of the scheduled broadcast eventfrom process blocks 406, 410, or 414. Once a scheduled broadcast eventis added or modified by the system administrator, a streaming device 102can automatically synchronize with the scheduled events in the datastore 306, 316 allowing for 100% unattended, automated live Internetstreaming of live broadcasts of user-created A/V content. In aconfiguration, each scheduled broadcast event can be stored in a record,or row, of a MySQL™ database table. For example, each scheduledbroadcast event can have a unique identifier, a date or day of the weekto start, a start time, and an end time. In a configuration, one-timeevents can be stored or indexed separately from recurring events. Inthis configuration, one-time events can be given a higher priority thanrecurring events, thereby allowing a one-time event to override arecurring event. Processing continues to process block 402 where theadded or modified scheduled broadcast event will be listed, and anydeleted scheduled broadcast event will not be presented.

In decision block 420, if the scheduling server 300 shuts down, or ifthe system administrator logs out or is logged out, then processingterminates at end block 422, otherwise processing continues back toprocess block 402.

Referring now to FIG. 5, an example flow diagram of a streaming device102, such as an encoder 112, and the scheduling server 300 is presented.Processing starts at start block 500 and continues to process block 502.

In process block 502, an encoder 112 accesses the scheduling server 300using a RESTful API call. The scheduling server 300 accesses data store306, 316 for broadcast scheduled events associated with the encoder 112.For example, an encoder 112 can execute automation software such as abatch file in Windows, or a shell script on a Mac or Linux operatingsystem, that causes the execution of PHP code that accesses the RESTfulAPI of the scheduling server 300 that queries the MySQL™ for records, orrows, that match a unique account ID associated with the encoder 112that is passed to the scheduling server 300 in each RESTful API call.All broadcast scheduled events associated with the unique account ID ofthe encoder 112 are determined by the scheduling server 300 and aresponse is provided to the encoder 112 using the RESTful API from thescheduling server 300. In a configuration, the scheduling server 300 canadjust the timestamp for the RESTful API call to the appropriate localtime zone of the encoder based on account information if necessary. Thescheduling server 300 checks the schedule of broadcast events bycomparing the timestamp of the RESTful API call from the encoder 112against start and stop times of each scheduled broadcast event stored inthe MySQL™ database to determine a response to provide the encoder 112using the RESTful API in order to start or stop a streaming process, orif no action needs to be taken. In the event of a conflict betweendifferent broadcast scheduled events, rules can be applied to determinewhich scheduled broadcast event takes precedence. For example, aone-time event can take precedence over a recurring event. Processingcontinues to decision block 504.

In decision block 504, if the date and time of when the encoder 112 madethe RESTful API call to the scheduling server 300 meets the date andtime requirements of a scheduled broadcast event for streaming A/Vcontent, and streaming is not currently in process, then processingcontinues to process block 506 where the streaming A/V content isstarted after receiving the appropriate “start” response from thescheduling server 300 using the RESTful API. In a configuration, thescheduling server 300 using the RESTful API can check a flag orattribute associated with the record, or row, in the MySQL™ database forthe scheduled broadcast event to determine whether streaming iscurrently in process. Otherwise, processing continues to decision block508.

In process block 506, the encoder 112 starts streaming A/V content tothe origin server 122. In a configuration, the encoder 112 can execute abroadcast script such as a Visual Basic Script if the encoder 112 isexecuting the Windows operating system, or a Shell Script if the encoder112 runs the Mac or Linux operating systems. The specific broadcastscript can be configured based on the particular encoding software anddesired encoding profiled. For example, the script can execute AdobeFlash Media Live Encoder, Telestream Wirecast, ffmpeg, or Windows MediaEncoder through a command line interface and configure the audio andvideo inputs, the bitrates, the resolution, and other information suchas publishing points and credentials. The encoder 112 can stream theencoded A/V content to the origin server 122. The A/V content can bedistributed by the origin server 122 to the edge servers 124 and theedge servers 124 can simultaneously stream the A/V content to awaitingviewers in real-time. Processing continues to process block 512.

In decision block 508, if streaming of A/V content is in process and theencoder 112 determines based on the response from the scheduling server300 using the RESTful API that the date and time of the RESTful API calldoes not meet the date and time of any broadcast scheduled event, thenprocessing continues to process block 510 where streaming is terminated,otherwise processing continues to process block 512.

In process block 510, the encoder 112 stops streaming A/V content, tothe origin server 122. In a configuration, the encoder 112 can execute astop broadcast script such as a Visual Basic Script if the encoder 112is executing the Windows operating system, or a Shell Script if theencoder 112 runs the Mac or Linux operating systems. The specific stopbroadcast script can be configured based on the particular encodingsoftware and desired encoding profiled. For example, the script canexecute Adobe Flash Media Live Encoder, Telestream Wirecast, ffmpeg, orWindows Media Encoder through a command line interface. Processingcontinues to process block 512.

In process block 512, one or more flags or attributes associated withthe record, or row, in the MySQL™ database for the scheduled broadcastevent can be updated by the scheduling server 300 using the RESTful APIto indicate, for example, whether streaming is in process or has beenstopped. In a configuration, a flag can be set to indicate whether theencoder 112 is streaming or is not streaming A/V content to the originserver. An attribute such as the current time of each successful RESTfulAPI call for the encoder 112 can also be stored or updated. Thetimestamp can be used as heartbeat indicator to provide a systemadministrator with an indication that the encoder 112 is currentlyactive and communicating periodically with the scheduling server 300using the RESTful API. In an alternative configuration, process block512 only updates one or more of the flags or attributes after thestreaming has started or has been stopped in process blocks 506 and 510respectively. Processing continues to decision block 514.

In decision block 514, if the encoder 112 is shut down, then processingterminates at end block 520, otherwise processing continues to processblock 516.

In process block 516, a delay can be configured so that the encoder 112only periodically, and at regular intervals, checks for broadcastscheduled events as described in process block 502. In a configuration,the delay can be implemented in software using a timer that isdecremented or incremented as appropriate. In a configuration, the delaytime can be any suitable period of time and can be configurable. In aconfiguration, the delay time is approximately 30-seconds. In thisconfiguration, the schedule of broadcast scheduled events is checked forupdate approximately once every 30-seconds and the heartbeat indicatorof process block 512 is updated approximately once every 30-seconds. Inthis way, if a new streaming event is added, or a current streamingevent is deleted, the encoder 112 will make the appropriate change tostart or stop streaming less than a minute after the update is made bythe system administrator. Processing continues to decision block 518 todetermine if the delay time has transpired.

In decision block 518, if the delay time has transpired, processingreturns to process block 502, otherwise processing continues back toprocess block 516.

Generally, the operations described in process blocks and decisionblocks 400 through 520 can be performed in any order, as would beunderstood by one of ordinary skill in the art. For example, decisiontree of adding, modifying, or deleting a scheduled broadcast event indecision blocks 404, 408, and 412 respectively can be rearranged intoany suitable order.

Referring now to FIG. 6, example communication flows 600 of an automatedreal-time Internet streaming system 100 are presented. An administrator602 can execute software, such as a web browser, application, or mobileapp, which opens a communication link 614 to a cloud-based server 604for scheduling streaming events for encoders. The administrator 602sends a schedule request 616 to the cloud-based server 604 for a futurelive streaming event to be streamed.

Example communication links can be an IP (Internet Protocol)communication channel and use UDP (User Datagram Protocol) or TCP(Transmission Control Protocol) messaging to send messages between thecomputing device of the administrator 602, the cloud-based server 604,an encoder 606, the original server 608, the one or more edge servers610 and viewing devices of the viewers 612, and any suitable message orprotocols can be used. In a configuration, communication links can bethe same communication link. For example, if TCP/IP is used, once acommunication link is established between the computing devices, a newcommunication channel does not need to be established for futuremessaging. If a communication link is terminated or has timed out a newlink may need to be established. In another configuration, communicationlinks can be different communication links. For example, if UDP/IP isused, each communicated datagram can be considered to establish a newephemeral communication link between the computing devices. Although thecommunication links are shown as individual links, a singlecommunication channel can remain open and transmitting multipledifferent messages over the same communication link for a period of timeas would be understood by one of ordinary skill in the art.

The cloud-based server 604 can open communication channels 618 and 620to the origin server 608 and the edge server 610 respectively and sendinformation about the streaming event 622. The origin server 608 and theedge server 610 can use the information about the streaming event 622 toprepare for the transmission of a live streaming event in the future.

At any point, a viewer 612 on a viewing device can open a communicationchannel 632 to find a listing of streaming events 638 on the edge server610. In an example configuration, the viewer 612 sends a web-basedrequest 634 using a web browser to the edge server 610 which in returnssends the list of events 638 over a communication channel 636 to theviewer 612. The list of events 638 can be archived A/V streams 646 andcan also include future live streaming events to which the viewer 612can subscribe and watch at some point in the future when the scheduledevent begins to stream live. The viewer 612 can subscribe 642 over acommunication link 640 to an event. If the event is an archived A/Vstream 646, then the edge server 610 can begin streaming the archivedA/V stream 646 over a communication link 644.

Periodically, as described above in reference to FIG. 5, the encoder 606can open a communication link 624 to the cloud-based server 604 and senda query 626 using a RESTful API call to determine the appropriate actionto take. The cloud-based server 604 can evaluate a list of scheduledstreaming events and determine the appropriate formatted response 630for the encoder over a communication link 628, such as a “start” or“stop” response 630. If no scheduled streaming events are currentlyactive, the cloud-based server 604 responds with a “wait” response 630causing the encoder 606 to wait for a specified period of time beforetrying again.

The encoder 606 will periodically continue to query 626 the cloud-basedserver 604. When the cloud-based server 604 determines that it is timeto start the scheduled event 616, it responds to the encoder 606 with a“start” command, the encoder 606 will then open a communication link 648to the origin server 608 and start streaming the live A/V stream 650 tothe origin server 608. The origin server 608 will open communicationlinks 652 to one or more edge servers 610 and copy the live A/V stream654 to the edge servers 610. The edge servers 610 will opencommunication links to each viewer 612 that previously subscribed 642 tothe event and distribute 658 the live stream to the viewers 612. Viewers612 can also subscribe to ongoing live streaming events and the edgeservers 610 will distribute 658 the live stream to those viewers 612 aswell.

While the live streaming 650 is occurring, an administrator 602 can opena communication link 660 to the cloud-based server 604 and send aninstruction to modify or delete 662 the scheduled live streaming event.When the encoder 606 periodically sends the next query 626 to thecloud-based server 604, the list of scheduled events will no longerinclude the live streaming event. Similarly, if the end time for thelive streaming event has passed, the list of scheduled events will nolonger include the live streaming event. The encoder 606 can open acommunication link 664 with the origin server 608 and send an endmessage 666 to indicate that the live streaming has ended. The originserver 608 can open a communication link 668 to one or more edge servers610 and send a copy 670 of the archived A/V stream to the edge servers610, and viewers 612 can watch the archived A/V stream at any time asdescribed above.

Automated real-time Internet streaming systems in accordance with thepresent disclosure can allow administrators to start, modify and stoplive Internet broadcasts at their venues without human intervention byutilizing encoders or other devices running automation software.Administrators can manage their Internet streaming broadcasts remotelyusing a cloud-based scheduling application easily and effortlesslywithout any physical intervention with the onsite broadcasting system.For example, houses of worship can utilize the system to broadcast theirservices without having to hire a staff or find a volunteer tophysically start and stop the broadcast at their venue. For example, anadministrator can schedule a recurring weekly service at their house ofworship using the cloud-based scheduling application. The house ofworship can use an encoding device connected to a high-definition camerathat automatically starts and stops the live broadcasts at the house ofworship based on the scheduled times, thereby allowing congregants toview the live service in real time without having to physically attendthe service. Additionally, or alternatively, a school administrator canoutfit a classroom with this system and program the system toautomatically broadcast classroom activities without requiring theteacher to start and stop the broadcast for each lecture. For example, ateacher can schedule daily lectures using the cloud-based schedulingapplication and an encoding device such as a computer with an attachedor built-in webcam in her classroom can start and stop automatically atthe appropriate times. The webcam can stream the lectures live toseveral pupils at home who are sick with the flu or otherwise unable toattend class.

In general, it will be apparent to one of ordinary skill in the art thatat least some of the embodiments described herein can be implemented inmany different embodiments of software, firmware, and/or hardware. Thesoftware and firmware code can be executed by a processor or any othersimilar computing device. The software code or specialized controlhardware that can be used to implement embodiments is not limiting. Forexample, embodiments described herein can be implemented in computersoftware using any suitable computer software language type, using, forexample, conventional or object-oriented techniques. Such software canbe stored on any type of suitable computer-readable medium or media,such as, for example, a magnetic or optical storage medium. Theoperation and behavior of the embodiments can be described withoutspecific reference to specific software code or specialized hardwarecomponents. The absence of such specific references is feasible, becauseit is clearly understood that artisans of ordinary skill would be ableto design software and control hardware to implement the embodimentsbased on the present description with no more than reasonable effort andwithout undue experimentation.

Moreover, the processes described herein can be executed by programmableequipment, such as computers or computer systems and/or processors.Software that can cause programmable equipment to execute processes canbe stored in any storage device, such as, for example, a computer system(nonvolatile) memory, an optical disk, magnetic tape, or magnetic disk.Furthermore, at least some of the processes can be programmed when thecomputer system is manufactured or stored on various types ofcomputer-readable media.

It can also be appreciated that certain portions of the processesdescribed herein can be performed using instructions stored on acomputer-readable medium or media that direct a computer system toperform the process steps. A computer-readable medium can include, forexample, memory devices such as diskettes, compact discs (CDs), digitalversatile discs (DVDs), optical disk drives, or hard disk drives. Acomputer-readable medium can also include memory storage that isphysical, virtual, permanent, temporary, semi-permanent, and/orsemi-temporary.

A “computer,” “computer system,” “host,” “server,” or “processor” canbe, for example and without limitation, a processor, microcomputer,minicomputer, server, mainframe, laptop, personal data assistant (PDA),wireless e-mail device, cellular phone, pager, processor, fax machine,scanner, or any other programmable device configured to transmit and/orreceive data over a network. Computer systems and computer-based devicesdisclosed herein can include memory for storing certain software modulesused in obtaining, processing, and communicating information. It can beappreciated that such memory can be internal or external with respect tooperation of the disclosed embodiments.

In various embodiments disclosed herein, a single component can bereplaced by multiple components and multiple components can be replacedby a single component to perform a given function or functions. Exceptwhere such substitution would not be operative, such substitution iswithin the intended scope of the embodiments. The computer systems cancomprise one or more processors in communication with memory (e.g., RAMor ROM) via one or more data buses. The data buses can carry electricalsignals between the processor(s) and the memory. The processor and thememory can comprise electrical circuits that conduct electrical current.Charge states of various components of the circuits, such as solid statetransistors of the processor(s) and/or memory circuit(s), can changeduring operation of the circuits.

Some of the figures can include a flow diagram. Although such figurescan include a particular logic flow, it can be appreciated that thelogic flow merely provides an exemplary implementation of the generalfunctionality. Further, the logic flow does not necessarily have to beexecuted in the order presented unless otherwise indicated. In addition,the logic flow can be implemented by a hardware element, a softwareelement executed by a computer, a firmware element embedded in hardware,or any combination thereof.

The foregoing description of embodiments and examples has been presentedfor purposes of illustration and description. It is not intended to beexhaustive or limiting to the forms described. Numerous modificationsare possible in light of the above teachings. Some of thosemodifications have been discussed, and others will be understood bythose skilled in the art. The embodiments were chosen and described inorder to best illustrate principles of various embodiments as are suitedto particular uses contemplated. The scope is, of course, not limited tothe examples set forth herein, but can be employed in any number ofapplications and equivalent devices by those of ordinary skill in theart. Rather it is hereby intended the scope of the invention to bedefined by the claims appended hereto.

I claim:
 1. A method, comprising: receiving, by a scheduling server, aquery from one of a plurality of media streaming devices, wherein eachof the plurality of media streaming devices is a remote media streamingdevice, wherein the query is associated with time and date information;comparing, by the scheduling server, one or more scheduled eventsassociated with the one of the plurality of media streaming devices withthe time and date information associated with the query; determining, bythe scheduling server, that one of the scheduled events is an activescheduled event based at least in part on the comparing operation;sending, by the scheduling server and to the one of the plurality ofmedia streaming devices, a response to the query, wherein the responseto the query instructs the one of the plurality of media streamingdevices to start streaming; and receiving, by a media server and fromthe one of the plurality of media streaming devices, a media streamassociated with the active scheduled event.
 2. The method of claim 1,wherein the media server receives the media stream from the one of theplurality of media streaming devices in substantially real-time.
 3. Themethod of claim 1, wherein the scheduling server receives periodicqueries from each of the plurality of media streaming devices, whereineach query is a RESTful API call, wherein each query includes atimestamp, and further comprising: determining, by the schedulingserver, an operational state of each of the plurality of media streamingdevices based at least in part on a plurality of timestamps.
 4. Themethod of claim 1, further comprising: receiving, by the schedulingserver, a subsequent query from the one of the plurality of mediastreaming devices, wherein the subsequent query is associated with timeand date information; comparing, by the scheduling server, the activescheduled event with time and date information associated with thesubsequent query; determining, by the scheduling server, that the activescheduled event is no longer active based at least in part on thecomparing operation; sending, by the scheduling server and to the one ofthe plurality of media streaming devices, a response to the subsequentquery, wherein the response to the subsequent query instructs the one ofthe plurality of media streaming devices to stop streaming the mediastream.
 5. The method of claim 1, further comprising: receiving, by thescheduling server, a scheduled event prior to receiving the query fromthe one of the plurality of media streaming devices, wherein thescheduled event is associated with a start time and an end time, whereinthe scheduled event is one of the one or more scheduled eventsassociated with the one of the plurality of media streaming devices. 6.The method of claim 5, further comprising: receiving, by the schedulingserver, a change to one or more of the start time and the an end time ofthe scheduled event.
 7. The method of claim 6, wherein the schedulingserver sends a response to either start streaming or stop streaming themedia stream only in response to receiving a query from the one of theplurality of media streaming devices after receiving the change to theone or more of the start time and the an end time of the scheduledevent.
 8. The method of claim 1, wherein the media stream is selectedfrom the group consisting of an audio stream, a video stream, anaudio-video stream, a live feed of unprocessed audio-video content, anduser-created content.
 9. The method of claim 8, further comprising:streaming, in substantially real-time, the media stream or a resampledversion of the media stream to one or more viewing devices.
 10. Themethod of claim 1, further comprising: receiving, by a second mediaserver and from the media server, the media stream or a resampledversion of the media stream; and archiving the media stream, or theresampled version of the media stream, for subsequent streaming by oneor more viewing devices.
 11. A real-time Internet streaming system,comprising: a media server configured to receive media streams; and ascheduling server configured to receive and store attributes for one ormore scheduled events associated with a streaming device positioned in alocation remote from the scheduling server, wherein the streaming deviceis one of a plurality of streaming devices, and wherein each of theplurality of media streaming devices is a remote media streaming device,receive a query from the streaming device, wherein the query istimestamped with time and date information; determine that one of thescheduled events associated with the streaming device is an activescheduled event based at least in part on a comparison of the time anddate information of the query with the attributes of the one or morescheduled events, and respond to the query from the streaming devicewith a response based at least in part on whether the one of thescheduled events is an active schedule event, and wherein when the oneof the scheduled events is an active scheduled event, the responseinstructs the streaming device to stream a media stream to the mediaserver.
 12. The real-time Internet streaming system of claim 11, whereinthe scheduling server is further configured to receive a subsequentquery from the streaming device, wherein the subsequent query istimestamped with time and date information; determine that an activescheduled event is no longer active based at least in part on acomparison of the time and date information associated with thesubsequent query and the attributes of the active scheduled event, andwherein the response instructs the streaming device to stop streamingthe media stream to the media server.
 13. The real-time Internetstreaming system of claim 11, further comprising: a plurality ofstreaming devices, wherein each streaming device is configured toperiodically query the scheduling server and receive a response from thescheduling server, wherein each query is a RESTful API call, whereineach query includes a timestamp, wherein the scheduling server isfurther configured to determine an operational state of each streamingdevice based at least in part on a plurality of timestamps, and whereineach media stream is selected from the group consisting of an audiostream, a video stream, an audio-video stream, a live feed ofunprocessed audio-video content, and user-created content.
 14. Thereal-time Internet streaming system of claim 11, wherein the mediaserver is configured to stream the media stream or a resampled versionof the media stream to one or more viewing devices in substantiallyreal-time.
 15. The real-time Internet streaming system of claim 11,further comprising: a second media server configured to receive themedia stream or a resampled version of the media stream from the mediaserver, and stream the media stream or a resampled version of the mediastream to one or more viewing devices in substantially real-time. 16.The real-time Internet streaming system of claim 15, wherein the secondmedia server is further configured to archive the media stream, or aresampled version of the media stream, for non-real-time streaming byone or more viewing devices.
 17. A media streaming device, comprising: avideo encoder configured to convert audio and video into a media stream;and a network-enabled controller in communication with the video encoderand configured to query, periodically, a remote scheduling server for aninstruction of whether to stream a media stream to a media serverassociated with the scheduling server, wherein the query is associatedwith time and date information, receive, in response to the query, aresponse from the remote scheduling server that includes theinstruction, wherein the instruction instructs the media streamingdevice to start streaming for a scheduled event, and wherein theinstruction is based on whether the scheduled event associated with themedia streaming device is an active scheduled event at the time of thequery based on the time and date information associated with the query,and stream the media stream, in substantially real-time, to the mediaserver based on the instruction from the remote scheduling server. 18.The media streaming device of claim 17, wherein the network-enabledcontroller is further configured to close the media stream to the mediaserver when, subsequent to querying the scheduling server, theinstruction in the response to the query directs the network-enabledcontroller to stop streaming the media stream to the media server. 19.The media streaming device of claim 17, wherein the query to thescheduling server includes a unique identifier of the media streamingdevice and a timestamp, and wherein the query is a RESTful API call.